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1 Introduction 



This paper is a treatment of the Merton portfoho management problem in the context of non- 
exponential discounting. What makes this problem non-standard is that with non-exponential 
discounting, in the absence of a commitment technology, the optimal policies computed as some 
time may fail to remain optimal at later times. Therefore the notion of optimality is not robust 
across time in this paradigm. As it was pointed out in [6j one way out of this predicament is to 
consider equilibrium policies. These are policies which the decision maker at some point in time 
would have no incentive to infinitesimally deviate from them, given that at some later times she 
agrees to follow them. 

Existing Research In the financial-economic literature there is an interest in studying 
decision-making problems where the discount rate may not be constant. Most of the results are 
in discrete time framework. The only paper in a continuous setup is [5]. For more on this see 



Dynamic asset allocation in a Brownian motion model received allot of attention and the 
main paper in this area is due to Merton [13]. In [6] we gave an overview of the works in the 
context of Merton portfolio management problem with exponential discounting. In [6] we have 
a first attempt in addressing the issue of non-exponential discounting. By means of duality we 
described the equilibrium policies by a flow of backward differential equations (BSDEs). In order 
to simplify the problem we considered special cases of discounting for which it was possible to 
reduce the flow of BSDEs to systems of partial differential equations PDEs. During this process 
we came up with a choice for the value function which was deflned through an integral equation. 
The duality method employed it turned out usefull, specially for the inflnite horizon problem, 
in deriving transversality like conditions. One of the novelty of [6] is the non-uniqueness of the 
equilibrium policies. 

Our Contributions 

The present paper is a natural extension of [6j. We are able to use the value function 
approach beyond the special cases of discounting considered in [6]. The key observation is that 
the value function deflned by an integral equation also satisfles an integral-differential equation 
which is reminiscent of the classical Hamilton-Jacobi-Bellmann equation. However this equation 
has a non-local term due to nonconstant discount rate. In the case of exponential discounting 
it coincides with the Hamilton-Jacobi-Bellmann equation. We prove that a concave smooth 
solution of the integral equation characterizing the value function leads to an equilibrium policy. 
This equation seems complicated and a general existence result is beyond the scope of this work. 
However if one restricts to CRRA preferences existence of a smooth solution is established in 
this paper. In that case the integral equation can be reduced to an one dimensional equation for 
which we proved existence and uniqueness. Moreover this one dimensional equation is amenable 
to numerical treatments so one can compare the equilibrium policies arising from different choices 
of discounting. We leave this as a topic of further research. 

Organization of the paper The reminder of this paper is organized as follow. In section 
2 we describe the model and formulate the objective. Section 3 contains the main result and is 
split in two parts: the model without the intertemporal consumption and the model without the 
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utility of the final wealth. Section 4 treats the special case of CRRA type utilities. The paper 
ends with Appendix containing the proofs. 

2 The problem formulation 

2.1 The model description 

Following [6] we adopt a model for the financial market consisting of a saving account and one 
stock (risky asset). The inclusion of more risky assets can be achieved by notational changes. 
The saving account accrues interest at the riskless rate r > 0. The stock price per share follows 
an exponential Brownian motion 

dS{t) = S{t)[adt + adW{t)], < t < oo, 

where {W^(i)}tg[o,oo) is a 1— dimensional Brownian motion on a filtered probability space 
{Q, {Tt}o<t<T , ^ ■ The filtration {Tt}o<t<T is the completed filtration generated by 
{W{t)}t^[Q^ao)- As usual Q is the mean rate of return and o" > is the volatility. Let us denote 
by^ = a — r>0 the excess return. 

2.2 Investment-consumption policies and wealth processes 

A decision-maker in this market is continuously investing her wealth in the stock/bond and 
is consuming. An investment-consumption policy is determined by the proportion of current 
wealth he/she invests in the bond/stock and by the consumption rate. Formally we have: 

Definition 2.1 An M.'^-valued stochastic process {C(^)) c(t)}tg[o,co) is called an admissible policy 
process if it is progressively measurable, c{t) > 0, for all t S [0, oo) and it satisfies 

/ \({u)fj, — c{u)\ du + / \( (u) a du < oo, a. s., for all t €^ [0, oo). (2-1) 
Jo Jo 

Given a policy process {C(*)) c(t)}tg[o,oo)) C{t) is the proportion of wealth, denoted by X^''^(t), 
invested in the stock at time t and c{t) is the consumption rate. The equation describing the 
dynamics of wealth X^''^{t) is given by 

dX'^^^t) = X^^%t) {{aC{t) - c{t)) dt + aC{t) dW{t)) + (1 - C{t))X'^'%t)r dt 

= X^^%t){{r + ^xC{t)-c{t))dt + cjC{t)dW{t)). (2.2) 

It simply says that the changes in wealth over time are due solely to gains/loses from investing 
in stock, from consumption and there is no cashflow coming in or out. This is usually referred 
to as the self-financing condition. 

Under the regularity condition (j5.8p imposed on {C(0; c(t)}fg[o,oo) above, equation ()2.2p 
admits a unique strong solution given by the explicit expression 

X^'^(t) = X(0) exp [r + fiC{u) - c{u) - ^\(tC{u)\^^ ^ / ^^^^^ dW{u) 

The initial wealth X^'^(O) = X{0) G (0, oo), is exogenously specified. 
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2.3 Utility Function 

At all times the decision-maker has the same von Neumans-Morgenstern utility. This is crucial 
for understanding the model: time-inconsistency arise, not from a change in preferences, but 
from the way the future is discounted. The decision maker is deriving utility from intertemporal 
consumption and final wealth. Let U be the utility of intertemporal consumption and U the 
utility of the terminal wealth at some non-random horizon T (which is a primitive of the model) . 
Here the functions U and C/, defined on (0, oo) M are strictly increasing and strictly concave. 
We restrict ourselves to utility functions which are continuous differentiable and satisfy the Inada 
conditions 

;7'(0+) = lim;7'(x) = oo, C/'(oo) = lim ^/'(x) = 0. (2.3) 

We shall denote by /(•) the (continuous, strictly decreasing) inverse of the marginal utility 
function [/'(•), and by ([23]) 

7(0+) = lim/(x) = oo, /(oo) = lim I{x) = 0. (2.4) 

xlO x]rX) 

2.4 Discount Function 

Unlike other works in this area we do not restrict ourselves to the framework of exponential 
discounting. Following [5], a discount function /i : [0, oo] ^ M is assumed to be continuously 
differentiable, positive, with: 

/i(0) = 1, h{s) > 0, 



and 



Moreover we assume that 



oo 



h{t) dt < oo. 







inf h(t) > 0. (2.5) 
te[o,r] 

This implies that the discount rate function — ^ is bounded. 
2.5 The objective 

We conclude this section by formulating our problem. The objective is to find time consis- 
tent policies and the optimal ones may fail to have this feature. Indeed, as shown in [6] if 
the agent starts with a given positive wealth x, at some instant t, her optimal policy process 
{Ct(s), Q(s)}5g[( J'] is chosen such that 



supE 



E 



T 



h{u - t)U{c{u)X'^^^{u)) du + h{T - t)U{X'^'^{T)) 



T 



h{u - t)U{ciu)X^'^{u)) du + h{T - t)UiX^'^{T)) 
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The value function associated with this stochastic control problem is 



V{t, s, x) = supE 



h{u - t)U{c{u)X^^^{u)) du + h{T - s)U{X^'^{T)) 



X(s) =x 



t < s < T, and it solves the following Hamilton-Jacobi-Bellman equation 



— {t,s,x) + sup 

OS 



[r + ^C- ^l^~Q^y^^ s,x) + -a C X -Q^{t, s, x) 



+ ^J' % {t,s,x) + U{xc) = 0, 
h[s — t) 



with the boundary condition 



V{t,T,x) = U{x). 

The first order necessary conditions yield the t— optimal policy {Ctis),ct{s)}s£[t,T] 

^^{t,s,x) 



Ct{s,x) 



ct{s,x) 



<y'^x^{t,s,x) 



I&,s,x)) 



t<s<T, 



t< s <T. 



(2.6) 



(2.7) 



(2.8) 



Therefore, unless the discounting is exponential (in which case ^ = constant, so there is no 
t dependence in the HJB), the t— optimal policy may not be optimal after t. That is 



{Ctis),ct{s)}s(zw^T] + argniaxE 



h{u - i!)'U{c{u)X^^\u)) du + h{T - t')U{X^'\T)) 



for some subsequent instant t', so the decision-maker would implement the optimal policy at 
later times only if she is constrained to do so. 

The resolution is to introduce equilibrium policies, that is, policies which, given that they 
will be implemented in the future, it is optimal to implement them right now. Let us consider: 



- Fi{s,x) F2{s,x) 
C{s,x) = , c[s,x) = 



(2.9) 

X X 

for some functions Fi, F2. The corresponding wealth process {^(s)}se[o,T] evolves according to 



dX{s) = [rX{s)+ ^lFl{s,X{s))- F2{s,X{s))]ds + aFi{s,X{s))dW{s). 



(2.10) 



Following [6j the functions Fi,F2 will be chosen such that on [t, t + e] it is optimal (this is made 



precise in our formal definition of equilibrium policies) to pick (^{t, x) 



Fi(t,x) 



c{t, x) 



F2{t,x) 



given that the agent's wealth at time t is x, and that for every subsequent instance s > t + e she 
follows (j2.9p . This intuition will be made precise in the following sections. 
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3 The Main Result 

3.1 The equilibrium policies and the value function 

Let T be a finite time horizon exogenously specified. In general, for a policy process 
{C(s), c(s)}sg[o^T] satisfying (12. ip and its corresponding wealth process {^(s)}sg[o,t] 
(see ()2.2p ) we denote the expected utility functional by 



J{t,x,C,c) = E 



h{s - t)[/(c(s)X*'^(s)) ds + h{T - t)U{X''''{T)) 



(3.1) 



Following [B] we shall give a rigorous mathematical formulation of the equilibrium policies in 
the formal definition below. 

Definition 3.1 A map F = {Fi,F2) : (0, oo) x [0, T] ^ M x [0,cx)) is an equilibrium policy for 
the finite horizon investment- consumption problem, if for any t,x > 



where 



^^.^^Jit,.,F,,F,)-Jit,.,C.,c.)^ 
40 e 



J{t,x,Fi,F2) ^ J{t,x,C,c), 



(3.2) 



X s) 



X s) 



(3.3) 



and {Cis),c{s)}s£[t.T] satisfies (15. Sp . The equilibrium wealth process {X{s)}s(^[t,T] is a solution 
of the stochastic differential equation (SDE) 

dX{s) = [rX{s) + ^iFi{s,X{s)) - F2{s,X{s))]ds + aFi{s,X{s))dW{s). (3.4) 

The process {Ce(s), Ce(s)}sg[f^r] is another investment- consumption policy defined by 



Us) 



CAS) 



C{s), s G E,^t, 

'c(s), s(^[t,T]\E,^t 
c(s), s e E.t, 



(3.5) 



(3.6) 



with E^^t = + e], dnd {C,{s),c{s)}s&Et,t is any policy for which {Ce(s), Ce(s)}sg[j.T] is an 
admissible policy. 

In [6j in a first step we characterize the equilibrium policies by means of duality. This 
methodology was illuminating and inspired us for a value function candidate. Thus following 
[6], the value function v should solve the following equation 



v{t, x) 



E 



h{s - t)[/(F2(s,X*'^(s))) ds + h{T - t)[/(X*'^(r)) 



(3.7) 
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Recall that {^(s)}se[o,r] is the equilibrium wealth process and it satisfies 

dX{s) = [rX{s) + fiFi{s,X{s)) - F2{s,X{s))]ds + aFi{s,X{s))dW{s), (3.8) 
where F = (Fi, F2) is given by 

Fi{t,x) = - ; \ , F2{t,x)=I —{t,x)], te[0,T]. (3.9) 



Of course the existence of such a function v satisfying the equation above is not a trivial 
issue. We can address it in some special cases (CRRA utilities for example). It turns out that 
the map F = (Fi, F2) is an equilibrium policy. The next Theorem which is the central result of 
the paper asserts this. 

Theorem 3.2 Assume there exists a concave function v of class C^'"^ which satisfies (]3.7p to- 
gether with (|3.8p and (jS.Op . Under the Assumptions \3. 51 or \3.9\ and \3.11\ the map F = {Fi, F2) 
given by (|3.9p is an equilibrium policy. 



Appendix A proves this Theorem. 

□ 

In the following, to ease to exposition, we present the two polar cases: 

• The case without intertemporal consumption: U = 0. 

• The case without the utility of the final wealth: U = 0. 

3.2 The case without intertemporal consumption 

In this case F2 = and we denote Fi = F. This case is easier to handle because the "aggregate" 
term is missing. The integral equation now becomes 

v{t, x) = E[h(T - t)Lf{X^'''(T))], (3.10) 

where {-^(•s)}sg[o,T] is the equilibrium wealth process defined by the SDE 

dX{s) = [rX{s) + nF{s, X{s))]ds + aF{s, X{s))dW{s), (3.11) 

and 

The next Lemma shows that a PDE equation is the analogue of the integral equation p.lUp . 
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Lemma 3.3 If a function v of class C^'^ satisfies the integral equation (j3.10p . then v solves the 
following PDE 

dv, , h'{T-t) , , dv, ^ /i2 ^ 

+ T^Kt,.) + - ^ly^ = 0, (3.13) 

the boundary condition 

v{T,x) = U{x). (3.14) 

Appendix B proves this Theorem. 

□ 

The existence of a solution for the PDE equation (j3.13p is estabUshed in the next Lemma. 

Lemma 3.4 There exists a unique concave C^'^ solution (with exponential growth) of the PDE 
(j3.13p with the boundary condition ()3.14p . 

Appendix C proves this Theorem. 

□ 

The solution of the PDE (|3.13p . with the boundary condition (|3.14p leads to equilibrium 
policies. However some technical assumptions are needed. 

Assumption 3.5 Given v the C^'^ solution of the PDE (I3.13p . with the boundary condition 
(|3.14p and the map F of ()3.12p . we assume that the SDE ()3.1ip has a strong solution. Moreover 
assume that the process Jq ^{s,X{s))aF{s,X{s))dW{s) is a (true) martingale. 

In the following we restrict ourselves to investment-consumption policies {C(0) c(t)}fg[Q 
as in the Definition 12.11 such that the process 

I —is,X^'''{s))aC{s)dW{s), is a martingale. (3.15) 
Jo ox 

Theorem 3.6 Assume that v the C^'^ solution of the PDE (j3.13p . with the boundary condition 
(13.14P satisfies Assumption \3. 51 Then the map F of (j3.12p is an equilibrium policy. 

Appendix D proves this Theorem. 

□ 
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Remark 3.7 The technical Assumption (13. Sp is met for power utilities Up{x) = In this case 
the value function v is of the form 

v{t,x) = X{t)Up{x), (3.16) 
for a function A which solves the ODE 

'h'{T-t 



\'{t) + 



h{T - t) 



+ rp + 



lj?p 



2C72(1 -p) 



\{t) = 0, A(r) = 1. 



(3.17) 



According to Lemma (13. 4p we know that v is the unique solution of the PDE (I3.13p . with boundary 
condition (j3.14p , so it must he of the form (|3.16p . Therefore the equilibrium policy is 



F{t,x) 



Hx 



Cj2(l-p)' 

hence the Assumption ()3.5p hold true. Indeed it suffices to prove that 

rT 



(3.18) 



E 



[ \X{s)\'^P ds <oo. 
Jo 



This follows from E|X(s)pP = e^''^, where K' = p yr + 2{T~py^J • for the admissible policies 
uniformly bounded (C,c) will satisfy the restriction ()3.15p . 

Remark 3.8 Notice that for the power utilities the equilibrium policy is to invest a constant 
proportion (which depends on the discount rate) into the risky asset. This is a special case and 
it has to do partly with stock return and volatilities being constant on one hand and on the other 
hand with the particular choice of utility. Notice that the optimal policies do not depend on the 
discount rate, since this being deterministic can be factored outside of the expectation operator. 

3.3 The case without the utihty of final wealth 

In this case set U = 0. The value function v{t, x) should satisfy the integral equation 



v{t,x) =E 



h{s -t)U{F2{s,X''='{s)))ds 



Recall that {^(s)}sg[o,T] is the equilibrium wealth process and it follows the SDE 
dX{s) = [rX{s) + ^Fi{s,X{s)) - F2is,X{s))]ds + aFi{s,X{s))dW{s), 

with 



Fi{t,x) 



F2it,x)=l(^Jt,x)], tE[0,T]. 



(3.19) 



(3.20) 



(3.21) 



The following Lemma derives a integro-differential equation analogue to the integral equation 
(j3.19p . We need the following technical assumption. 
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Assumption 3.9 For every s G [0, T] the PDF, defined on [0, s] x (0, oo), 



ft + (rx + fiFiit, x) - F2{t, x))f^ + 



has a C ' solution f = f{t,s,x). 



T^F^t^x) 



fxcc = 0, fis,s,x) = U{F2is,x)), (3.22) 



Lemma 3.10 Assume there exists a C^'^ solution v = v{t,x) of the integral equation (13.190 
and that the Assumption \3.9\ is satisfied. Then v{t,x) solves the following integro- differential 
equation 



dv . 
5t' 



dv 



{t,x)+[rx-l[—{t,x)] 



dv 



dx' ' ' 2a2 



+ UiF2{t,x)) 



(3.23) 



-E 



£ h'{s-t)u(^l(^^is,X''''is))^^ ds 



Appendix E proves this Lemma. 



□ 



In the fohowing we restrict ourselves to investment-consumption pohcies {C(0) c(t)}(g[o,oo) 
as in the Definition 12.11 such that the process 



/ —(s,X'^''^(s))a((s)dW(s), is a martingale. 
Jo dx 

Moreover we require that 



E sup \U{c{s)X<'%s))\ < oo, 

{0<s<T} 



(3.24) 
(3.25) 



and 



t+e 



lim- 



(r + ^(.)C(.) - c(.))AC'^(s))||(., AC'^(s))) 



+ 



(3.26) 



+ 



la\s)eis)iX^'%s))'^is,X<'%s))) 



ds 



dv 
di 



it,x) + 



du 1 u 

(r + ii{t)at) - c{t))x—{t, x) + 2'^'CV^(t, x) 



At this point another technical assumption is imposed. 
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Assumption 3.11 Assume there exists a C^'^ solution v = v{t,x) of the integral equation 
(|3.19|) . that the SDE (|3.2U|) has a strong solution, and that the process JjJ f^(S) ^{s))(tF{s, X{s)) dW{s) 
is a (true) martingale. Moreover assume that 

E sup \U{F2{s,X{s)))\ < oo, (3.27) 

{0<s<T} 

and that the policies 

- Fi{s,x) F2{s,x) 

C[s,x) = , c{s,x) = , 3.28 

X X 

satisfies (13.26p . 

Theorem 3.12 Assume there exists a concave function v of class C^''^ which satisfies the inte- 
gral equation ()3.19p and the A ssumptions 1 3. dl \3.11\ hold true. Then the map F = (Fi,i<2) given 
by (|3.2ip is an equilibrium policy. 

Appendix F proves this Theorem. 

□ 

4 CRRA Preferences 

In the case of U{x) = U{x) = Up{x) = let us look for the value function v of the form 
v{t,x) = X{t)Up{x), for a function X{t) which is to be found. Notice that 

Fi{t,x) = ^2(llp) ' F2{t,x) = [X{t)]^^x. 

In the light of (|3.19p the function X{t) should satisfy the following integral equation (IE) 

< A(t) = J^h{s - t)e^(^-*)[A(s)]^^e V' J ds + h{T - t)e^(^-*)e V* J 

MT) = l 

(4.1) 

where K = p ^r + 2(i-p)a^ ^ • '^^^ following Theorem grants existence and uniqueness for the 
solution of the above equation. 

Theorem 4.1 There exists a unique solution of pr]) . 
Appendix G proves this Theorem. 

□ 

Remark 4.2 In the context of CRRA preferences one can easily see that the A ssumptions 1 3. ^ 
and \3.1I\ hold true. Indeed in this case the PDF ()3.22p is just the classical Black-Scholes PDF 
hence assumption \3.S\ is met. As for the Assumption \3.11\ notice that the equilibrium wealth 
process is Gaussian. The class of uniformly bounded policies {C,, c) are admissible in the sense 
that the restrictions (13.24p . (13.25P and (I3.26P are met for this class. 
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5 Appendix 

A Proof of Theorem 13.21 The proof is a combination of Theorem 13.61 and Theorem I3.12f s 
proofs. 

□ 

B Proof of Lemma 13.31 

Proof: If a function v satisfies the integral equation (jS.lOp then the process is a 

martingale and v{T,x) = U{x). The result follows from Ito's formula. 

□ 

C Proof of Lemma 13.41 

Proof: Let us introduce the Legendre-Fenchel transform of U{x) 

U*{y) = sup[Uix) - xy], < y < oo. (5.1) 

a;>0 

The function {/*(•) is strictly decreasing, strictly convex and satisfies the dual relationships 

U*\y) = -x iff U'{x) = y. (5.2) 
Let V the unique (with exponential growth) convex C^'^ solution of 

^(t, y) + J^iv^yiy^ t) + vit, y)] + .,-(,, t) + ^.^^(t, .) = 0, (5.3) 
with the boundary condition 

v{T,y) = U*{y). (5.4) 
Note that the convexity of the function v is inherited from its boundary condition. Let 

v{t,x) = mf[xy + v{t,y)]. (5.5) 

y>0 



The following dual relations hold 



dv dv 

-^{t,y) = -x, iff —{t,x) = y, (5.6) 
oy ox 



and 

d'^v 
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where x and y are related by ()5.6p . Moreover by the Envelope Theorem ^{y,t) = ^{x,t). 
Then it is easy to see that v defined by (|5.5|) solves (|3.13|) . Moreover the concavity of v follows 
from ()5.7p . Conversely if is a C^'^ solution of (jS.lSp then the function 

x) = sup[w(t, x) — xy]. (5-8) 

solves (|5.3|) . 

□ 

D Proof of Theorem [STBl 

The claim yields if we prove that 

E[/i(T - t)U{X^'''{T))] > E[h{T - t)C/(X^'*'^(r))]. 

This follows since the process | | ^ ^ is a martingale, and the process | ^^^(^^J^^^^ | ^ ^ 

is a submartingale. Indeed it can be seen by applying Ito's formula and using concavity of v, 
that I ^[V^^^l^ \ has zero drift and I ""^f',^ ^^y'^ \ has negative drift. 



□ 



E Proof of Lemma 13.101 

Equation (|3.19p can be rewritten as 

v{t,x) = j^ h{s -t)f{t,s,x)ds, (5.9) 

where 

f{t,s,x)^E[U{F2{s,X''-{sm. 

For a fixed s the process {f {t, s, X {t))}Q<:t<s is a martingale. Thus by the Assumption 13.91 
the function / = f(t,s,x) satisfies the following PDE: 

ft + {rx + fiFi{t,x) - F2{t,x))f^ + ^-®^/,, = 0. (5.10) 
By differentiating ()5.9p with respect to t we get 

vt{t,x) = / h{s — t)ft{t, s, x) ds — / h'{s — t)f{t, s, x) ds. (5-11) 

Moreover 

7;i.(t,x) = / h{s -t)fx{t,s,x)ds. (5.12) 
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Vxxit,x)=j^ h{s - t)fxx{t,s,x)ds. 
In the light of ^M), KWl . KWl and KUtl it follows that 



vt{t,x) + (rx + fiFi{t,x) - F2{t,x))vx{t,x) + 



a-Ff{t,x 



■Vxx{t,x) + U{F2{t,3 



/ h'{s — t)f{t,s,x)ds, 



or equivalently 



-(t,x)+(,-x-l[^-(t,x)^^-(t.x) 



-E 



j\\s-t)u(^l[^{s,X'^-{s))y^ ds 



F Proof of Theorem [332] 

According to Lemma 13.101 v satisfies the integro-differential equation 



-E 



T 



h'{s-t)U[^l{^{s,X'^-{s))] ) ds 



In view of the concavity of function v this equation can be re-written as 



dv , , 
— +sup 



dt 



Let us notice that 



du 1 cf^%) 



-E 



J(t,x,Fi,F2) =t;(t,x) 



Moreover 
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Jit,X,F^,F2)-Jit,X,Ce,Ce)=E 



t+e 



h{s - t)[U{F2{s,X''='{s))) - C/(c(s)X*'^(s))] ds 



+E 



+nv{t + e, + e)) - v{t + e, + e))] 

[h{s -t)-h{s-t- e)][U{F2{s,X'^^{s))) - U{F2{s,X''^s)))] ds 



t+e 



The RHS of this equation has three terms and we will treat each of these terms separately: 
1. In the light of inequalities ()3.27p and (j3.25p and Dominated Convergence Theorem 



E 



lim- 
2. One has 



/;+^ h{s - t)[U{F2{s,X'^'{s))) - U{c{s)X'^^s))] ds 



U{F2{t,x) -U{cx). 



nvit + e, X''^{t + e)) - v{t + e, + e))] = 

E[v{t + e, + e)) - v{t, x)] - E[v{t + e, + e) - v{t, x)]. 



Moreover 



E[v{t + e, + e)) - v{t, x)]=E / dv{u, 



t+e 



Ito's formula and Assumption 13.111 vield 



, E r/+'d7;(n,X*'^(n)) dv 
lim — 



40 
Similarly 



dv \ \ dv 
^(t,.)+^rx-I^-(t,x)JJ-(t,x) 



^^^ E[v{t + €,X''''{t + €) -v{t,x)] 



40 



, E/,*+'dt.(u,X*'^(u)) dv 
lim — 



40 



1 d'^v 
{r + fiC- c)x—{t, x) + -a^C^x^ — (t, x) 



3. In the light of inequalities (j3.27p . (j3.25p and Dominated Convergence Theorem it follows 



that 



E 



lim- 



!t+eHs -t)-h{s-t- e)][U{F2{s, X'^^is))) - U{F2is, X^'^is)))] ds 



40 
Therefore 
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lim 



J{t,X,Fi,F2)- Jit,X,Ce,Ce) 



dv . . ( ^ { dv -.W dv . . 



+ C/(F2(t,x)) 



>0, 



+ U{cx) 



where the last inequality comes from ()5.16p 



□ 



G Proof of Theorem 14.11 

The proof of this Theorem will be split into several Lemmas. 



Lemma 5.1 Assume there exists a solution of the integral equation (j4.ip . Then there exists a 
positive constant A (that depends on T and h{-)) such that 



inf \{t) > e-^'^, 
te[o,T] 



sup \{t) < 
te[o,T] 



A 



A 



i-p 



Proof 

The equation ()4.ip can be written in differential form as 



X'it) 



h'{T-t) 
h{T - t) 

From the equation (14. 1|) we infer that 
t-T 



K 



\{t) + {p-l)[\{t)]—^ 



h{s - t) 
h{T - t) 



h{s-t)e^^'~'\X{s)] — e V* J 



ds < X{t). 



(5.17) 



(5.18) 



This together with the boundedness (from below and above) of the function h, yields a 
positive constant A (that depends on T and h{-)) such that 



X\t) < AX{t) + {p - l)[X{t)]- 



(5.19) 



and 
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p 



X'{t) > -AX{t) + {p-l)[X{t)]—K (5.20) 
It follows from ([5TT9]) that 

where 

m' 



Thus 

' e\.~J-d{t)] <-e^~J<0. 



Integrating this from t to T we obtain the lower estimate on A(t). Following (j5.19p and arguing 
similarly we can get the upper estimate on A(i). 

□ 

The next Lemma establishes uniqueness of ()4.ip . 
Lemma 5.2 There is a unique solution to (|4.ip . 
Proof 

We argue by contraposition. Let Ai and A2 two solutions of (|4.ip . Then in the light of the 
estimate of Lemma 15.11 it follows that 



h{T-t 
and 



■T 

< Ki I \\i{u)-X2iu)\du 



|[Ai(i)]^ - [A2(t)]^| < i^2|Ai(t) - A2(t)|, 



for some positive constants Ki and K2- Therefore there exists a positive constant such 
that 

|Al(t) - A2(t)| < ^3 ^ |Ai(^x) - \2{u)\du. 
At this point one can argue as in the Gronwal's Lemma proof to get that |Ai(t) — A2(t)| = 0. 

□ 
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Next we show existence of a solution of ()4.ip if the discount function h(t) is a combination 
of exponentials. 



Lemma 5.3 Let the discount function h{t) be of the form h{t) = for some positive 

constant such that X^^i /?« = 1- Then the equation (j4.ip has a unique solution. 

Proof 

The uniqueness is a consequence of Lemma 15.31 As for existence let us notice that the 
integral equation (j4.1|) can be reduced in this case to a system of ODE. Indeed let us denote 
hn{t) = e-P"K Then 



\n{t) = !^hn{s-t)e^^^-'\\{s)]^^ 

y\n{T) = i 

solves the following ODE system 



//p[A{u)]P-i du 



ds + hn{T — t)e 



K{T-t). 



f^p[\{u)\v-i du 



(5.21) 



\'^{t) = {p^-K)K{t) + {p-l)[\{t)]T- 

A„(r) = 1 

U(i) = Eli/3nA„(t) 



(5.22) 



Existence of a solution for this system is granted locally by The Schauder Fixed Point Theorem. 
However the estimates given by Lemma l5. II grant a solution globally. 

□ 



G Proof of Theorem 

Let C = {h ■ [0,r] ^ M| h{t) = T.n=i Pne' p^^] then C is dense in C([0,r],R). Thus the 
function h'{t) can be approximated by functions in C. Moreover h{t) an be approximated (in 
the sup norm) by h^{t) € C such that h'{t) is approximated (in the sup norm) by [h^]'{t). From 
infjgjo,T] ^(*) > it follows that for big enough n, inf^gjo.T] hn{t) > 0. Since 



h'^{T-t) d 
h"-{s -t)di 



/i"(s -t) 
/i"(T - t) 



h{T -t) d 
h{s -t)dt 



h{s - t) 
h{T - t) 



as n ^ oo, one can find for big enough n a constant A such that the estimates of Lemma 
15.11 hold with the same A (independent of n) if one considers the integral equation ()4.ip with 
h{t) = h'^{t) G C. The solution A"(t) is uniformly bounded in n. Moreover from (j5.18p we see 
it has uniformly bounded derivative so it is equicontinuous. Thus, Arzela-Ascoli compactness 
criterion grants convergence of A"(t) as n — > cx) to some function X{t). Passing at limit in (j4.ip 
with h{t) = h"'{t) £ C using Dominated Convergence Theorem (with the estimates of Lemma 
15.11 holding with the same A for all n) we get that A(t) solves (|4.ip . 



□ 
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